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Abstract. We discuss a basic thermodynamic properties of systems with multifractal structure. This 
is possible by extending the notion of Gibbs-Shannon's entropy into more general framework - 
Renyi's information entropy. We show a connection of Renyi's parameter q with the multifractal 
singularity spectrum /(a) and clarify a relationship with the Tsallis-Havrda-Charvat entropy. 
Finally, we generalize Hagedorn's statistical theory and apply it to high-energy particle colhsions. 



One of the fundamental observations of information theory is that the most general 
functional form for the mean transmitted information (i.e., information measure) is that 
of Renyi. Although Renyi's information measure offers perhaps the most general and 
conceptually cleanest setting for the entropy, it has not found so far as much applicability 
as its Shannon's counterpart. To clarify the position of Renyi's entropy in physics, we 
resort to systems with a multifractal structure. Such systems are very important and 
highly diverse, including phase transitions, turbulent flow of fluids, irregularities in 
heartbeat, population dynamics, chemical reactions, plasma physics, and most recently 
the motion of groups and clusters of stars. We shall argue that for the aforementioned 
the Renyi parameter is connected via a Legendre transformation with the multifractal 
singularity spectrum. To put some flesh on bones we generalize Hagedorn's statistical 
theory and subsequently apply to a differential cross section in high-energy scattering 
experiments. More thorough investigation will be published elsewhere. 



From information theory follows that the most general information entropy is that 
of Renyi [1]. In discrete cases where the probability distribution T = {pn} the Renyi 
entropy is defined as 



INTRODUCTION 



RENYI'S ENTROPY 



Motivation 




On the other hand, in continuous probability cases a renormalization is needed - 
with an arbitrary precision of measurement comes infinity of information. If f{x) is 
a probability density, say in the interval [a, b] one may define the integrated probability 



f{k+l)/n 



Pnk = 



/ f{x)dx, 

J k/n 



then [1] 



Iq{f) = lim (iqi'Pnk) -log2n) 



1 



l0g2 




f{x)dx 



(1) 



Eq.(l) might be generalized to any Lebesgue or Hausdorff measurable sets [2]. 

In the former context a natural question arises; how comes that there are other infor- 
mation entropies apart from Shannon's one. To understand this we should go to infor- 
mation theory. The latter asserts that the amount of information received by learning that 
an event of probability p took place (in bit units) is l{p) — — log2(p). In general, if the 
possible outcomes of an experiment are Jli , • • • , -^^m with corresponding probabilities 
pi,P2,....,Pn, and Jlk conveys bits, then the mean conveyed information is 



However, the linear averaging is only a specific case of a more general mean! It has 
been recognized by A.Kolmogorov [3] and M.Nagumo [4] that the most general mean 
compatible with postulates of probability theory gives the entropy 



where g is an arbitrary invertible function. 

Applying the postulate of additivity of independent information one obtains only two 
possible classes ofg [1], namely = cx + d which implies /(fp) = — Y!k=i Pk^^SiiPk) 
(i.e.. Shannon's information measure) and g{x) = c2^^~'i'>^ + d which implies directly 
Renyi's information measure lq{'P)- 

Among the basic properties of Renyi's entropy we may mention; positivity (Iq > 0), 
for ^ < 1 Renyi's entropy is concave but for ^ > 1 is not pure convex nor pure concave 
and, in addition, when q is continued to 1, Renyi's entropy equals Shannon's one, i.e., 
lim^^i lq = I. 

In physics Renyi's entropy has been sporadically, albeit successfully applied in vari- 
ous non-equilibrium dynamical systems, e.g., fully developed turbulence (q directly re- 
lates with Reynolds number), percolating clusters (q directly describes pc), etc.. It also 
provides a consistent mathematical setting for Tsallis-Havrda-Charvat (THC) entropy 
and, as we shall see, it is a correct entropy for (multi)fractal systems. 
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Connection with Tsallis-Havrda-Charvat entropy 



THC entropy introduced originally be J.H.Havrda and F.Charvat [5] and later applied 
to physical problems by C.Tsallis [6] is currently fruitfully used in many statistical sys- 
tems; 3-dimensional fully developed hydrodynamic turbulence, 2-dimensional turbu- 
lence in pure electron plasma, Hamiltonian systems with long-range interactions, gran- 
ular systems, systems with strange non-chaotic attractors, peculiar velocities in galactic 
clusters, etc.. Its form reads 
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q>0. 



Among important properties of THC entropy we can mention positivity (Sq > 0), 
concavity in ^, gibbsian limit: lim^^i Sq = I, and peculiar non-extensive behavior 

SqiA+B) = SgiA) +Sg{B) + {l-q)Sg{A)Sg{B) , 

for two independent events A and B. 



Renyi's entropy vs.THC entropy 

To find a connection between Renyi and THC entropies we utilize the expansion of 
log2(l +x). Then we may write 

h = (T^l«g2 [(1 -?)^.+ 1] = -^)^.'+ ^ [(1 -#^3 > (2) 

with the scale factor A; = ln2. So Iq Sq, provided 
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Condition (3) is fulfilled in numerous ways. For instance, when q ^ I, q ^ I, for 
systems with large deviations or for rare events systems [7]. 

At this stage some comments are in order. First of all we see from (2) that THC 
entropy and Renyi's entropy are monotonic functions of each other and, as a result, both 
are extremized by the same 'P . However, while Renyi's entropy is additive, THC entropy 
is not, so it appears that the additivity property is not important for entropies required 
for extremizing purposes. Thus from thermodynamic point of view both entropies give 
the same predictions (see e.g. ,[8])! 

Secondly, as we show in [7], Renyi's entropy provides a consistent renormalization 
prescription for a continuous THC entropy, we find that 
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FRACTAL AND MULTIFRACTAL SYSTEMS 



Brief introduction into (multi)fractal sets 

Fractals 

Let us begin to illustrate the basic features of fractals sets on a simple example - triadic 
Koch curve (TKC). The latter is defined iteratively in the following way: in 0th iteration 
{n = 0) we start with a straight line - initiator - with length tq = a. In the following 
step (n = 1) we raise an equilateral triangle over the middle third of initiator. The result 
is generator. Its four straight line segments (A^i = 4) have length r\ = a/3 and total 
length L[a/3] —Aa/2). The construction of the Koch curve proceeds by replacing each 

2 2 2 

segment of initiator with generator, i.e., for n = 2,r2= (1/3) a, L[(l /3) a] = (4/3) a 
and N2 = 16, etc. So when n = k we have = (l/3)^a, L[(l/3)^fl] = (4/3)^a and 
Nk = 4^. Note that the length L diverges as ^ oo ! 

Can we define somehow a finite length for the triadic Koch curve? The answer is yes, 
provided we extend the notion of euclidean dimension. To see this let us note that for 
ordinary smooth curves the approximative length is L[r] ~ N{r)r, and as r goes to zero 
L[r] approaches the finite limit - length; L = \imr^oN{r)r. 

Generalization to any Z)-dimensional volumes is then natural: V — limr^Q N{r)r^. 
However, in order to get V finite, the following scaling must apply 

c 1 
N(r) ~ — <^ logA''(r) ~ c + Dlog- , 

and so 

log N(r) 

lim ^ y =D. (4) 
r-^o logi 

As the LHS of (4) is well defined for wider class of sets than just usual metric spaces 
one may accept it as a generalized definition of dimension. The latter is usually called 
the Hausdorjf-Besicovitch or fractal dimension. It should be stressed that D in (4) is not 
necessarily integer - price which is paid for the finiteness of the volume. 

Thus, for instance, in the case of TKC the fractal dimension is 

_ logA^(r) log4" log4 ^ 

D = hm ^ ^ = hm , ^ = = 1.26. . . . 

r^O logi n^--log|r log3 

One may often write (e.g., for strictly self-similar fractals), after n iterations N = Nq 
(Nq is the number of pieces of the generator) r = ar^ (rQ is the length of the segments 
of the generator). In such cases the fractal dimension follows from a simple analysis: 

limA^(r)r^ = lim (NGr^Y = const. ^ D= . (5) 

o re 

Relation (5) allows to recover fairly simply some standard results; e.g., the well known 
triadic Cantor dust (re = 1 /3, No = 2) has D = log2/log3. 



Multifractals 



Multifractals are related to the study of a distribution of physical or other quantities 
on a generic support (be it or not fractal) and thus provide a move from the geometry of 
sets as such to geometric properties of distributions. An intuitive picture about an inner 
structure of multifractals is obtained by introducing the /(a) spectrum [9]. To elucidate 
the latter let us suppose that some support (usually a subset of a metric space) is covered 
by probability of a certain phenomenon. If we pave the support with boxes of size / 
and denote the integrated probability in the iih. box as pi, we may define the scaling 
exponent a, by pi{l) ~ The factor a, is called Lipshitz-Holder expomnt. Counting 
boxes dN{a, I) in which pi has a, G (a, a + da), then the singularity spectrum /(a) is 
defined as dN(a, I) = n(a)l~^^^^da (the proportionality function n{a) is / independent). 
Accordingly, we may view a multifractal as the ensemble of intertwined (mono)fractals 
each with its own fractal dimension /(«;). It is thus suggestive to define the "partition 
function" 

Z{q) =Y^p1^ f ^^a'n(a')/-^("')/^"' . (6) 

i 

In the small / limit the partition function (6) scales as Z{q) ~ P, where 

x(^) =mm(^a-/(a)), f'{a{q))^q. (7) 

Eq.(7) represents defining relations for the Legendre transformation. 



Renyi's entropy - entropy of self-similar systems 

Let us now turn to the question whether there is any connection of Renyi's entropy 
with (multi)fractal systems. At present it seems to us that there are two such connections. 



a) Formal connection - generalized dimensions 
Generalized dimensions are defined as: 

^ l-*Q\{q-\) log/ J 1^0 ' 

For example, Dq is the usual fractal dimension - dimension of the support, D\ is 
known as information dimension and D2 is correlation dimension. Do,Di and D2 are 
usually sufficient to describe simple fractals (e.g., strictly self similar ones). However, 
in general all Dq are necessary to pinpoint fractals uniquely. This is typical e.g., for 
strange attractors [11]! The situation is somehow analogous to statistical physics when 
the whole tower of correlation function equations (BBGKY hierarchy) is needed to get 
the full information on density matrix. 



b) Direct physical connection 



We will show now that from the maximal entropy (MaxEnt) point of view, extremizing 
the Gibbs-Shannon entropy on fractals is equivalent to extremizing directly Renyi's 
entropy without invoking the underlying fractal structure explicitly. 

Let us have a multifractal with a measure p{x). Shannon's entropy for the correspond- 
ing process is J = —Y^Pk^^SiPk- The Billingsley theorem then states [10] that there is 
an intimate connection between Shannon's entropy and the Hausdorff dimension of the 
measure theoretic support M of p{x) (i.e., the infimum of the dimensions of all sets on 
which p{x) lives). Namely, 

dhi!M ) = - jhn ^ £p,log2p, ~ ^ l^Pkmog^Pkie) , 

with the cutoff scale £ ^ l/N. In this connection it is useful to introduce a one- 
parametric family of normalized measures iu{q) (escort or zooming distributions) 



LjIpM" 

It is important to notice that the parameter q provides a microscope for exploring 
different regions of the singular measure. Indeed, for ^ > 1, iu{q) amplifies the more 
singular regions of p, while for ^ < 1, iu{q) accentuates the less singular ones. So one 
may zoom into any required regions of fractality. The corresponding "zooming" entropy 
i{q) = — T,kMk^og2iiik, and d/i of the measure theoretic support of //(^) then reads 

1 ^ 1 

/(?) = - lim Y,Mk^og2iUk ~ ] l^/^A:(e) log2^/fe(e) . (8) 

N^oo iog2 Y log2 e Y 

In addition, the average value of the singularity exponent a,- = log2(i?j)/log2£ with 
respect to //(^) is 

^( ^^L.R(e)log2P.(e)_ 
log2e 

Eqs.(8) and (9) establish a relationship between a Hausdorff dimension f{q) and an 
average singularity exponent a{q) via functional dependence on the parameter q. Note 
that f = qa — x, a = dx/dq is precisely the Legendre transformation. Thus Shannon's 
entropy on a multifractal with a given /(a) 
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= -qa{q)\og2E+{l-q)lg{'P). (10) 

a{q) 

So as long as we fix the "fractality" condition, Shannon's entropy I turns out to be 
(up to an additive constant) Renyi's entropy. Thus, from MaxEnt point of view / 1 y(oc) 
and iq are completely interchangeable^ . 



^ In [7] we show that ( 1 ) together with e ^ imply that / (/) |/(a) = ( 1 - ? ) -f? (/) • 



GENERALIZED HAGEDORN'S STATISTICAL THEORY 



Hagedorn's statistical theory is applicable whenever the density of quantum states grows 
exponentially with temperature, i.e., when 

v(£)ocexpM. (11) 

Assumption (11) applies for example to (quantized) string theory [12], to cosmic 
string theory [13], or to high-energy particle collisions [14]. 

Except a proliferation of the states near Th — I /|3//, the state space acquires an ap- 
proximately multifractal structure which is exact at critical point [14, 15]. This suggests 
that Renyi's rather than Gibbs entropy could better grasp vital features near Th ^. 



Differential cross section in high-energy scattering experiments 

Recent experiments suggest that Hagedorn's theory is not adequate for generic high- 
nergy scattering experiments. For instance, in e+e processes Hagedorn's description is 
satisfactory provided CMS energies are small (E < lOGev) but it fails at large energies. 
Hagedorn's approach at E > lOGeV predicts an exponential decay of differential cross 
sections while experiments observe a power-law behavior [16]. 

It addition, the latest applications of THC entropy in the context of high energy colli- 
sions [17], high energy cosmic ray physics [18] or a Focker-Planck equation treatment 
of charmed quarks in quark-gluon plasma [19] fit far better with experimental data than 
predictions based on the Gibbs-Hagedom approach. 

Hagedorn's theory basically predicts that the differential cross section in high-energy 
collisions should be 



1 da 



odpT 

which for large pr asymptotically behaves as 

1 do 3/2 _Bp 

cdpT 

Yet, for ep high-energy collisions the results are best fitted by a power law [16]; 

-^^(l+constpT)~^, Y = 5.8±0.5. (12) 
odpT 

Whereas ordinary thermodynamics (and hence Hagedorn's theory itself) is derived by 
extremizing Gibbs-Shannon entropy we extremize now Iq instead. Following Hagedom 
[14] we arrive at the probability density of transverse momenta p{pt) [V]; 

p(pT)°^uj^ dx (^l + {q-l)^-^x^ + u^ + mjj ^, 



^ Actually Renyi's statistics also modifies Th. Usually Tr < Th 



where u = ^pr and mp = Pmo. Using the fact that p(pr) °= do/dpr we have 

. , V2ta^, (I, _^ _ ^) „3/.,, ^ _ . (,3, 

Formula (13) agrees well with the fit (12), provided one suitably determines parame- 
ters c,q,T . This in turn may specify the multifractal structure of the state space. 

Finally note that (13) has its maximum at pr — T(^^), on the other hand, the exper- 
imentally measured cross sections, e.g., in relativistic heavy ion-collisions have maxi- 
mum at roughly the same value of pr ~ ISOMeV, so T/; (1 — q/3)pT ~ lOSMeV < 
Th = 158Mey. 



OUTLOOK AND OPEN QUESTIONS 

Because of a build-in predisposition to account for self-similar systems Renyi's entropy 
naturally aspires to be an effective tool to describe phase transitions. It is thus a chal- 
lenging task to find a closer connection with such typical tools of critical-phenomena 
physics as are conformal and renormalization groups. 

In addition, witnessing an encouraging agreement of THC non-extensive statistics 
predictions with the cosmic ray experiments [18] or heavy-ion collisions [20] we may 
naturally ask whether there is a physical grounding for Renyi's entropy in similar (non- 
equilibrium) systems. Work along those lines is currently in progress. 
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